Comparing Examination Standards without Graded Candidate Scripts

<p style="text-align: justify;">Comparative judgement methods are commonly used to explore standards in examination papers over time. However, studies limited by a paucity of graded candidate scripts from previous years, as well the expense and time required standardise scripts. We present three that attempted, without use scripts, replicate extend results about mathematics papers. found re-typesetting into consistent format was necessary, but comparative an archive offered reliable efficient method for revealing relative demand Our approach enables comparison where previously this not possible. reasonable correlation between judgments actual student items only, meaning conclusions may be drawn even when available.</p>